REPORT  DOCUMENTATION  PAGE 


Form  Approved  OMB  NO.  0704-0188 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions, 
searching  existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments 

regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggesstions  for  reducing  this  burden,  to  Washington 

Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington  VA,  22202-4302. 
Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  oenalty  for  failing  to  comply  with  a  collection  of 
information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


5c.  PROGRAM  ELEMENT  NUMBER 
611102 


5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 


12.  DISTRIBUTION  AVAILIBILITY  STATEMENT 
Approved  for  Public  Release;  Distribution  Unlimited 

13.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  contrued  as  an  official  Department 
of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 

14.  ABSTRACT 

The  project  has  made  important  accomplishments  in  the  following  inter-related  areas  centered  on  target  information 
processing  by  joint  decision  and  estimation:  (a)  theory  and  algorithm  development  for  joint  decision  and 
estimation;  (b)  target  information  processing,  particularly  for  target  tracking  under  equality  and/or  inequality 
constraints;  (c)  theory  and  algorithm  development  for  data  fusion  for  estimation;  (d)  UAV  team  path  optimization 
for  search  and  track;  (e)  variable-structure  algorithms  and  model-set  design  methods  for  multiple-model  approach 

15.  SUBJECT  TERMS 

target  infonnation  processing,  estimation  fusion,  estimation  and  filtering,  multiple-model  estimation,  perfonnance  evaluation,  UAV 
path  optimization 

17.  LIMITATION  OF  15.  NUMBER 

ABSTRACT  OF  PAGES 

UU 

Standard  Form  298  (Rev  8/98) 
Prescribed  by  ANSI  Std.  Z39. 1 8 


19a.  NAME  OF  RESPONSIBLE  PERSON 

X.  Rong  Li _ 

19b.  TELEPHONE  NUMBER 
504-280-7416 


16.  SECURITY  CLASSIFICATION  OF: 


a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

UU 

UU 

UU 

7.  PERFORMING  ORGANIZATION  NAMES  AND  ADDRESSES 

University  of  New  Orleans 
2000  Lakeshore  Drive 

New  Orleans,  LA  70148  - 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND 
ADDRESS(ES) 

U.S.  Anny  Research  Office 
P.O.  Box  12211 

Research  Triangle  Park,  NC  27709-2211 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


10.  SPONSOR/MONITOR'S  ACRONYM)  S) 
ARO 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

54370-CS.81 


5d.  PROJECT  NUMBER 


3.  DATES  COVERED  (From  -  To) 

1 -Sep-2008  -  29-Feb-2012 

5a.  CONTRACT  NUMBER 

W91  INF-08-1-0409 _ 

5b.  GRANT  NUMBER 


2.  REPORT  TYPE 
Final  Report 

4.  TITLE  AND  SUBTITLE 
Final  Report 

ARO  project  (ARO  W91  INF-08- 1-0409) 

Target  Information  Processing:  A  Joint  Decision  and  Estimation 
Approach 

6.  AUTHORS 

X.  Rong  Li,  Vesselin  P.  Jilkov,  Huimin  Chen 


1.  REPORT  DATE  (DD-MM-YYYY) 
30-03-2012 


Report  Title 


Final  Report 

ARO  project  (ARO  W911NF-08- 1-0409) 

Target  Information  Processing:  A  Joint  Decision  and  Estimation  Approach 

ABSTRACT 

The  project  has  made  important  accomplishments  in  the  following  inter-related  areas  centered  on  target  information  processing  by  joint 
decision  and  estimation:  (a)  theory  and  algorithm  development  for  joint  decision  and  estimation;  (b)  target  information  processing, 
particularly  for  target  tracking  under  equality  and/or  inequality  constraints;  (c)  theory  and  algorithm  development  for  data  fusion  for 
estimation;  (d)  UAV  team  path  optimization  for  search  and  track;  (e)  variable-structure  algorithms  and  model-set  design  methods  for 
multiple-model  approach  to  target  information  processing;  and  (f)  performance  and  credibility  evaluation  of  decision  and  estimation 
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Selected  Accomplishments 


Joint  Decision  and  Estimation 

With  a  few  exceptions  that  involve  decision  and  estimation  separately,  most  target  information  processing  problems  require 
joint  decision  and  estimation  (JDE).  The  underpinning  of  our  research  is  a  new  paradigm  for  an  integrated  approach  to  JDE, 
based  on  a  novel  Bayesian  formulation,  and  an  optimal  solution  in  this  paradigm.  The  main  advantage  of  this  approach  is  that 
the  problems  of  decision  and  estimation  are  solved  jointly,  rather  than  separately  or  in  two  stages  as  in  the  existing  approaches. 
Not  only  does  it  beat  the  traditional  decide-then-estimate  or  estimate-then-decide  approaches,  but  it  also  provides  additional 
strengths  and  flexibilities  that  are  important  to  handle  many  target  information  processing  problems. 

Significant  accomplishments  have  been  made  on  this  topic.  More  specifically,  we  have  proposed  an  intuitively  appealing  and 
generally  applicable  objective  function  (Bayes  risk)  as  the  optimality  criterion  for  the  JDE  problem.  Based  on  the  proposed 
Bayes  risk,  we  have  formulated  the  JDE  problem  mathematically  in  a  general,  flexible  Bayesian  setting,  which  is  capable  of 
handling  most  practical  JDE  problems,  especially  problems  of  target  information  processing.  In  this  general,  flexible  setting  we 
have  derived  the  optimal  solution  to  the  JDE  problem  theoretically.  Further,  we  have  developed  an  optimal,  iterative  JDE 
algorithm  based  on  the  above  optimal  theoretical  solution.  We  have  also  recognized  a  general  method  of  making  the  optimal 
decision  efficiently. 

JDE  is  for  solving  problems  involving  inter-dependent  decision  and  estimation  and  was  proposed  recently  by  us  based  on  a 
generalized  Bayes  risk.  Our  above  JDE  algorithm  processes  data  in  a  batch  manner.  This  batch  method  is  computationally 
inefficient  or  infeasible  for  many  dynamic  JDE  problems  where  measurements  are  made  available  sequentially.  Therefore,  we 
proposed  a  recursive  version  of  the  JDE  algorithm,  which  fits  the  dynamic  JDE  problems  more  naturally  and  inherits  JDE’s 
theoretical  superiorities.  Further,  we  also  proposed  a  joint  performance  measure  in  the  measurement  space  for  dynamic  JDE 
problems.  To  our  knowledge,  this  is  the  only  performance  evaluation  framework  currently  available  for  JDE  evaluation. 

For  the  JDE  approach  of  this  project,  we  have  applied  it  to  several  problems  in  different  areas.  We  have  developed  algorithms 
for  joint  identification  and  tracking  of  multiple  chemical,  biological,  radiological,  nuclear,  and  explosive  (CBRNE)  clouds  based 
on  sparsity  pursuit.  We  have  also  developed  procedures  for  joint  estimation  of  state  and  parameter  in  power  systems  using 
synchrophasor  measurements. 

Target  Information  Processing 

Target  information  processing  refers  to  processing  of  information  concerning  an  uncertain  number  of  targets  in  an  uncertain 
environment  using  uncertain,  imprecise,  and/or  vague  data  from  single  or  multiple  sources.  It  includes  target  detection, 
discrimination,  classification,  recognition,  identification,  as  well  as  tracking.  Many  target  information  processing  problems 
involve  both  estimation  (i.e.,  approximate  a  continuous-valued  quantity)  and  decision  (i.e. ,  choose  one  from  a  discrete  set  of 
candidates).  Decision  in  this  sense  includes  detection,  discrimination,  classification,  recognition,  identification,  selection, 
association,  ranking,  hypothesis  testing,  matching,  etc.  Parameter  estimation,  signal,  image,  or  state  estimation,  prediction, 
filtering,  smoothing,  forecasting,  and  regression  are  examples  of  estimation.  Target  detection,  discrimination,  classification, 
recognition,  and  identification  are  basically  decision  problems,  which  often  contain  embedded  estimation  sub-problems.  Target 
tracking  are  primarily  estimation  problems  with  embedded  decision  sub-problems. 

We  have  completed  two  important  parts  of  an  ongoing  in-depth  up-to-date  survey  on  maneuvering  target  tracking:  (a)  models  of 
ballistic  and  space  targets  and  (b)  nonlinear  filtering  techniques.  The  nonlinear  filtering  part  consists  of  three  subparts.  This 
series  has  already  made  considerable  impact  on  target  tracking  research  and  development.  In  addition,  we  have  developed 
nearly  optimal  algorithms  for  target  tracking  using  range  and  direction  cosine  measurements,  which  is  a  nonlinear  filtering 
problem  whose  optimal  solution  is  beyond  practical  region.  Other  significant  contributions  include:  (a)  development  of  hybrid 
grid  multiple-model  estimation  approach  and  its  application  to  maneuvering  target  tracking;  (b)  development,  implementation, 
and  performance  study  of  several  parallel  particle  filtering  algorithms  for  real-time  satellite  tracking,  and  joint  multitarget 
probability  density  tracking  of  ground  targets  (track-before-detect)  using  computer  cluster  and  graphics  processing  unit. 

Estimation  and  filtering  theory  is  one  of  the  most  important  foundations  of  target  information  processing.  We  have  made 
significant  contributions  in  this  aspect.  More  specifically,  we  have  developed  a  new  framework  for  state  estimation  with  point 
and  set  measurements  that  can  handle  effectively  many  diverse  applications,  including  particularly  many  practical  problems  in 
target  information  processing.  Highly  related  with  this  new  framework,  we  also  investigated  estimation  and  filtering  for 
Gaussian  variables  with  linear  inequality  constraints.  This  has  important  applications  in  ground  (especially  on-road)  target 
tracking. 

The  states  of  some  dynamic  systems  satisfy  certain  constraints  arising  from  physical  laws,  mathematical  properties,  or  practical 
constraints.  A  typical  example  is  ground  target  tracking  on  a  road  network.  We  have  made  significant  contributions  in  several 


aspects  of  this  important  topic.  First,  we  have  proposed  several  algorithms  in  different  forms  of  the  linear  minimum  mean 
square  estimator  for  this  problem.  They  are  all  optimal  in  the  linear  class.  Second,  we  have  developed  a  general  method  to 
construct  an  unconstrained  dynamic  model  that  is  mathematically  equivalent  to  the  original  system  with  constraints,  thus 
simplifying  the  constrained  problem  to  an  unconstrained  problem.  This  model  has  several  important  desirable  properties, 
including  clear  physical  interpretation  and  high  computational  efficiency.  Third,  we  have  made  an  important  finding:  under 
certain  conditions,  although  equality  constraints  are  indispensable  in  the  evolution  of  the  state,  update  by  them  is  redundant  in 
optimal  filtering;  however,  if  there  is  model  mismatch,  update  by  equality  constraints  is  necessary  and  helpful.  Fourth,  unlike 
the  existing  system  conversion  based  design  techniques,  we  propose  a  new  systematic  way  to  design  and  analyze  linear 
equality  constrained  linear  dynamic  systems  through  a  direct  elimination  technique,  where  the  desired  model  class  is  given  and 
only  the  distribution  of  the  initial  state  and  driven  process  noise  needs  to  be  determined.  This  method  is  comparatively  much 
easier.  We  also  found  that  the  existing  formulations  of  linear  equality  constrained  linear  dynamic  systems  only  cover  a  small 
part  of  the  whole  class. 

Based  on  our  work  in  these  areas,  we  have  also  developed  algorithms  and  designs  for  aided  strapdown  inertial  navigation  for 
autonomous  underwater  vehicles.  This  was  a  practical  project  funded  by  the  Naval  Oceanographic  Office. 

Data  Fusion  for  Estimation 

Estimation  fusion  is  data  fusion  for  the  purpose  of  estimating  some  quantity,  usually  a  parameter  or  a  process.  It  is  an  essential 
part  of  target  information  processing  when  multiple  sensors  are  used.  Abundant  results  in  this  area  have  been  obtained.  They 
include  several  aspects. 

•  Optimal  fusion  requires  knowledge  of  cross-correlation.  Unfortunately,  this  knowledge  is  sometimes  unavailable  in 
practice.  In  view  of  this,  we  have  developed  three  fault-tolerant  fusion  rules  for  this  case:  fast  covariance  intersection, 
generalized  convex  combination,  and  analytic  center  approach. 

•  We  have  proposed  several  compression  rules  for  sensor  data  based  on  which  optimal  distributed  fusion  will  have 
performance  that  is  globally  optimal  under  fairly  general  conditions. 

•  We  have  developed  optimal  LMMSE  fusion  in  the  form  of  quasi-tracklets  to  handle  cross-correlated  cases,  along  with 
analysis  of  its  performance  and  presentation  of  necessary  and  sufficient  condition  for  its  optimality. 

•  Estimation  fusion  for  the  case  of  multiple  dynamic  and/or  measurement  models  was  never  considered  before  due  to  its 
complexity.  We  have  successfully  developed  several  such  fusers. 

•  Almost  all  existing  fusion  results  rely  on  some  level  of  probabilistic  or  statistical  description  of  the  problem,  which  is  not 
available  or  appropriate  in  some  cases.  With  this  understanding,  we  proposed  a  new  formulation  in  the  H-infinity  setting,  which 
is  robust  against  descriptions  and  assumptions,  and  successfully  developed  several  corresponding  rules  for  centralized  and 
distributed  fusion,  which  is  applicable  even  to  nonlinear  delayed  systems  with  multiple  sensors. 

•  Besides  fusion  results  for  filtering,  we  have  also  obtained  theoretical  results  for  fusion  for  optimal  smoothing,  which  has 
been  largely  overlooked  so  far  by  the  fusion  community. 

UAV  Team  Path  Optimization  for  Search  and  Track 

To  better  serve  the  Army's  mission,  one  application  focus  of  the  project  is  path  planning  of  a  team  of  unmanned  aerial  vehicles 
(UAV)  for  joint  detection,  localization,  and  tracking  of  multiple  targets.  Another  is  ground  target  tracking — track  an  uncertain 
number  of  possibly  crossing  targets  using  data  transmitted  from  multiple  sensors  (e.g.,  imagers  and  radars)  onboard  a  moving 
platform  as  well  as  topographic  information  such  as  road  maps. 

Most  UAV  team  missions  have  a  dual  purpose  of  search  and  surveillance,  which  entails  not  only  finding,  but  also  monitoring  of 
targets,  including  their  locations  and  motions.  Among  the  central  topics  of  UAV  missions  is  path  planning  for  search  and 
surveillance.  It  is  vastly  different  from  the  traditional  path  planning  (e.g.,  in  robotics),  which  is  largely  a  “how-to-go-from-A-to-B” 
problem.  Traditional  search  or  tracking  theoretic  approaches  based  on  optimizing  detection  probability  or  estimation  error  would 
not  meet  the  diverse,  competing  needs  of  a  UAV  mission.  Unlike  existing  path  planning  of  a  cooperative  UAV  team,  which 
handles  the  competing  objectives  in  a  piecemeal  manner,  we  took  a  systematic  JDE  approach:  we  proposed  a  solution  based 
on  the  introduction  of  a  new  performance  index — gain  in  the  information  value — which  permits  naturally  joint  optimization  of  the 
objectives  of  target  detection,  target  tracking,  and  vehicle  survivability  nicely  for  search  and  track  missions. 

More  recently,  we  have  obtained  significant  theoretical  results  for  dynamic  re-planning  of  the  UAV  team  path  for  detection, 
localization,  and  tracking  that  is  capable  of  adapting  to  real-time  changes  in  the  command,  intelligence,  environment,  etc. 

These  results  are  significantly  more  solid  than  existing  ones.  In  a  dynamic  situation,  events  that  call  for  a  change  of  the  plan 
may  occur,  including  the  arrival  of  a  new  command  or  intelligence,  detection  of  a  new  target,  loss  of  a  UAV,  a  sudden  change  of 
weather,  etc.  Therefore,  an  appropriate  time  horizon  for  re-planning  must  be  determined.  If  it  is  too  long  or  too  short,  the 
updated  plan  may  be  poor.  There  is  little  research,  if  any,  regarding  the  determination  of  the  optimal  planning  horizon.  We  have 
initiated  a  theoretical  study  of  this  important  topic.  Our  work  presents  a  planning  horizon  that  is  optimal  in  the  sense  of 
minimizing  errors  in  planning  time.  It  is  intended  for  the  use  in  mission  planning  but  has  many  other  applications. 


Technically,  UAV  path  planning  for  target  detection,  localization,  and  tracking  is  a  problem  of  constrained  multiple-objective 
optimization.  As  is  well  known,  there  is  an  optimal  set  (i.e.,  Pareto  front)  in  which  each  point  corresponds  to  a  certain  tradeoff 
among  the  values  of  the  objective  functions.  Solutions  to  such  a  problem  are  not  unique  in  general.  Which  of  the  many  Pareto 
optimal  points  is  the  “best  trade-off’?  A  decision  is  needed  as  to  which  Pareto  optimal  point  provides  the  best  tradeoff  among  all 
alternatives.  A  natural  approach  is  to  optimize  a  convex  combination  of  the  individual  objectives.  We  have  developed  such  a 
solution  for  cooperative  UAV  path  optimization,  along  with  an  efficient  method  of  getting  the  weights  from  the  Pareto  optimal 
points.  We  are  developing  methods  based  on  a  special  scalar  objective  function  that  suits  particularly  well  to  our  problem  of 
UAV  path  optimization  for  joint  detection,  localization,  and  tracking  of  multiple  targets. 

Multiple-Model  Approach 

The  multiple-model  (MM)  approach  can  be  treated  as  a  special  case  of  the  joint  decision  and  estimation  (JDE)  approach,  which 
is  the  focus  of  this  project.  It  provides  the  state-of-the-art  solutions  to  many  problems  involving  estimation,  filtering,  control, 
decision,  and/or  modeling.  It  has  three  generations:  autonomous  MM,  cooperating  MM,  and  variable-structure  MM  (VSMM),  of 
which  the  VSMM  is  the  most  advanced  and  powerful.  Significant  results  have  been  obtained  in  several  aspects. 

•  We  have  developed  three  new  VSMM  approaches:  (a)  best-model  augmentation  (BMA),  (b)  hybrid  grid,  and  (c) 
second-order  Markov  chain.  BMA  is  a  general  and  promising  new  VSMM  algorithm.  It  is  a  generalization  of  the  well-regarded 
expected-mode  augmentation  (EMA)  algorithm  developed  by  us  before.  It  is  applicable  whenever  EMA  is  and  they  are  virtually 
the  same.  BMA  still  applies  when  EMA  does  not,  such  as  when  models  have  different  structures.  The  hybrid-grid  approach 
uses  a  model  set  that  is  a  combination  of  a  fixed  coarse  grid  and  an  adaptive  fine  grid.  The  second-order  Markov  chain  based 
multiple-model  algorithms  developed  is  particularly  suitable  for  maneuvering  target  tracking. 

•  Perhaps  the  most  important  task  in  the  application  of  the  MM  approach  is  the  design  of  model  set.  We  have  also  made 
significant  progress  in  this  aspect.  We  have  proposed  two  model-set  design  methods.  The  uniform  model  set  design  is  based 
on  number  theory  and  has  general  applicability.  The  second,  moment-matching  based  approach  is  particularly  suited  to  the 
hybrid-grid  approach  to  MM  estimation  developed  recently. 

•  Taking  advantage  of  the  great  power  of  the  MM  approach,  we  have  also  formulated  the  problem  of  fault  detection  and 
isolation  in  the  MM  setting  and  provided  a  solution  that  outperforms  by  far  existing  ones.  This  has  been  done  for  vastly  different 
applications:  (a)  sensor,  actuator,  or  system  faults  of  an  aircraft  (b)  heating,  air  conditioning,  and  ventilation  (HAVC)  in  building 
automation  and  (c)  machine  wear  prognostics  and  remaining  useful  life  prediction. 

•  In  addition,  we  have  obtained  significant  results  for  distributed  MM  fusion,  that  is,  fusing  local  estimates  obtained  based  on 
multiple  dynamic  models. 

Evaluation  of  Decision  and  Estimation  Algorithms 

Science  and  engineering  abound  in  algorithms  for  decision  or  estimation.  However  solid  such  an  algorithm  is  in  theory,  its 
performance  and  characteristics  must  be  evaluated  in  practice  to  serve  a  number  of  purposes,  such  as  verification  of  its  validity, 
demonstration  of  its  performance,  and  comparison  with  other  solutions. 

We  have  developed  a  novel,  theoretically  solid  approach  to  performance  evaluation  that  is  general,  comprehensive,  and 
straightforward  to  implement  without  the  need  to  know  the  ground  truth.  It  can  always  rank  very  different  decision  algorithms 
objectively;  it  has  no  difficulty  for  cases  with  two  or  more  choices  (or  hypotheses),  misspecification  (i.e.,  the  truth  is  not  one  of 
the  hypotheses),  and/or  where  hypotheses  are  composite  (i.e.,  having  unknown  parameters);  and  it  does  not  need  to  know  the 
functional  form  of  the  truth  or  hypotheses.  This  is  a  very  significant  development.  It  is  potentially  a  breakthrough  in  decision 
performance  evaluation.  Past  and  existing  measures  of  decision  performance  are  seriously  flawed  or  limited.  Our  method  is 
the  only  one  known  to  us  that  overcomes  many  difficulties  (including  all  those  listed  above)  naturally  and  easily. 

We  have  developed  an  array  of  metrics  that  measure  absolute  or  relative  performance  of  estimation.  They  suit  different 
applications.  We  have  clarified  widespread  misuse  of  and  misconception  about  the  most  popular  estimation  metric: 
root-mean-square  error.  We  have  also  introduced  an  important  concept  of  optimism,  pessimism,  and  neutralism  to  characterize 
many  estimation  performance  metrics  regarding  whether  they  focus  on  good  or  bad  performance.  We  have  also  initiated  the 
study  of  comprehensive  measures  of  estimation  performance  evaluation.  The  practical  value  of  these  largely  theoretical 
developments  has  been  quickly  recognized  by  the  target  information  processing  community.  For  example,  based  on  his  team’s 
comparative  studies,  Dr.  Erik  Blasch  of  Air  Force  Research  Laboratory  appraised  highly  of  the  practical  value  of  our  work  on 
performance  evaluation  metrics  for  data  fusion  and  target  tracking  and  classification. 

Most  estimators  and  filters  provide  assessments  of  their  own  estimation  errors,  often  in  the  form  of  mean-square  error  and  bias. 
Are  these  self-assessments  trustable?  What  is  the  degree  to  which  they  are  trustable?  We  have  raised  such  questions 
formally,  referred  to  as  credibility  of  estimators,  formulated  the  problem  theoretically,  and  provided  two  types  of  solutions: 
credibility  tests  for  qualitative  questions  of  the  first  kind  and  credibility  measures  for  quantitative  questions  of  the  second  kind. 
These  results  are  significant.  They  address  an  important  practical  problem  of  estimation  that  has  been  largely  overlooked  in 


theory  but  are  badly  needed  in  practice.  We  have  also  shown  that  one  of  the  credibility  measures  developed  is  truly  a  distance 
metric  and  have  good  application  in  many  areas  outside  credibility  evaluation,  such  as  statistics,  data  fusion,  matrix  theory,  and 
general  data  driven  performance  evaluation. 

We  also  applied  theoretical  study  in  performance  metrics  and  statistical  inference  algorithms  to  haplotype  inference  problem  in 
bioinformatics,  orbital  evasive  target  tracking  and  sensor  management  in  space  situational  awareness,  joint  identification  and 
tracking  of  contaminate  clouds,  remaining  useful  life  prediction  of  battery  and  other  mission  critical  components  in  fault 
prognosis. 


Technology  Transfer: 

We  have  been  and  are  collaborating  with  several  small  business  companies  for  technology  transfer.  Several  joint  SBIR/STTR 
proposals  for  such  collaboration  have  been  submitted,  based  partially  on  results  from  a  former  ARO  project  and  this  ARO 
project.  Two  of  them  were  successful: 

l  “Multiple  Target  Tracking  of  Objects  Exhibiting  Significant  Nonlinearities,”  jointly  with  ObjectVideo,  Inc.,  funded  by  Air  Force 
Research  Lab  in  the  amount  of  $150,000  for  Phase  I. 

I  “An  Integrated  Constellation  Sensor  Simulation  Environment  for  Airborne  ISR,”  jointly  with  DCM  Research  Resources,  LLC, 
funded  by  the  Air  Force  Research  Lab  in  the  amount  of  $100,000  for  Phase  I. 

Research  results  of  a  former  ARO  project  and  this  ARO  project  have  been  applied  to  this  SBIR  project.  We  have  active 
ongoing  collaboration  with  many  researchers  elsewhere,  including  DoD  labs,  DoE  lab,  and  numerous  companies.  We  are 
actively  seeking  collaboration  with  researchers  at  Army,  Navy,  and  Air  Force  R&D  facilities. 

Based  on  the  research  of  this  ARO  project,  we  have  also  secured  the  following  funded  research  projects: 
l  A  research  project  titled  “Coordinated  Search  and  Surveillance  by  a  UAV  Team”  on  the  development  of  flight  path 
optimization  and  control  of  a  coordinated  UAV  team  for  search  and  track  missions,  funded  by  the  Department  of  Homeland 
Security  in  the  amount  of  $200,000  for  20  months.  The  project,  led  by  us,  is  a  team  work  with  QinetiQ  North  America  and  the 
Ben-Gurion  University  of  Israel.  The  cornerstone  of  the  project  is  the  introduction  of  an  expected  information  gain  as  the 
objective  function.  It  is  a  special  case  of  the  general  JDE  method  developed  in  the  ARO  project,  tailored  particularly  for  UAV 
search  and  track  missions. 

I  The  study  on  nonlinear  filtering  techniques,  particularly  its  application  in  maneuvering  target  tracking,  supported  by  this 
ARO  project  forms  part  of  the  basis  for  the  three-year  project  titled  “High  Performance  Parallel  &  Distributed  Algorithms  for 
Nonlinear  Particle  Filtering,”  funded  by  Louisiana  Board  of  Regents  in  the  amount  of  $109,143. 

I  Based  on  our  work  in  these  areas,  we  have  developed  algorithms  and  designs  for  aided  strapdown  inertial  navigation  for 
autonomous  underwater  vehicles.  This  was  a  practical  project  funded  by  the  Naval  Oceanographic  Office  in  the  amount  of 
$100,000  for  one  year.  The  performance  evaluation  results  obtained  in  this  project  was  critical  in  evaluating  the  navigation 
performance  of  this  project. 
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Abstract 

The  project  has  made  important  accomplishments  in  the  following  inter-related  areas 
centered  on  target  information  processing  by  joint  decision  and  estimation:  (a)  theory  and 
algorithm  development  for  joint  decision  and  estimation;  (b)  target  information 
processing,  particularly  for  target  tracking  under  equality  and/or  inequality  constraints;  (c) 
theory  and  algorithm  development  for  data  fusion  for  estimation;  (d)  UAV  team  path 
optimization  for  search  and  track;  (e)  variable-structure  algorithms  and  model-set  design 
methods  for  multiple-model  approach  to  target  information  processing;  and  (f) 
performance  and  credibility  evaluation  of  decision  and  estimation  algorithms.  Some  of 
these  accomplishments  have  fundamental  theoretical  value  and  some  others  have 
important  practical  significance.  Most  of  the  accomplishments  have  been  disseminated  in 
the  form  of  publication,  which  includes  23  journal  articles  (16  appeared  or  to  appear  and 
7  submitted),  55  conference  proceedings  papers  (42  appeared  and  13  submitted),  and  3 
book  chapters  (2  appeared  and  1  to  appear). 

Selected  Accomplishments 

Joint  Decision  and  Estimation 

With  a  few  exceptions  that  involve  decision  and  estimation  separately,  most  target 
information  processing  problems  require  joint  decision  and  estimation  ( JDE ).  The 
underpinning  of  our  research  is  a  new  paradigm  for  an  integrated  approach  to  JDE,  based 
on  a  novel  Bayesian  formulation,  and  an  optimal  solution  in  this  paradigm.  The  main 
advantage  of  this  approach  is  that  the  problems  of  decision  and  estimation  are  solved 
jointly,  rather  than  separately  or  in  two  stages  as  in  the  existing  approaches.  Not  only 
does  it  beat  the  traditional  decide-then-estimate  or  estimate-then-decide  approaches,  but  it 
also  provides  additional  strengths  and  flexibilities  that  are  important  to  handle  many 
target  infonnation  processing  problems. 

Significant  accomplishments  have  been  made  on  this  topic.  More  specifically,  we  have 
proposed  an  intuitively  appealing  and  generally  applicable  objective  function  (Bayes  risk) 
as  the  optimality  criterion  for  the  JDE  problem.  Based  on  the  proposed  Bayes  risk,  we 
have  fonnulated  the  JDE  problem  mathematically  in  a  general,  flexible  Bayesian  setting, 


which  is  capable  of  handling  most  practical  JDE  problems,  especially  problems  of  target 
information  processing.  In  this  general,  flexible  setting  we  have  derived  the  optimal 
solution  to  the  JDE  problem  theoretically.  Further,  we  have  developed  an  optimal, 
iterative  JDE  algorithm  based  on  the  above  optimal  theoretical  solution.  We  have  also 
recognized  a  general  method  of  making  the  optimal  decision  efficiently. 

JDE  is  for  solving  problems  involving  inter-dependent  decision  and  estimation  and  was 
proposed  recently  by  us  based  on  a  generalized  Bayes  risk.  Our  above  JDE  algorithm 
processes  data  in  a  batch  manner.  This  batch  method  is  computationally  inefficient  or 
infeasible  for  many  dynamic  JDE  problems  where  measurements  are  made  available 
sequentially.  Therefore,  we  proposed  a  recursive  version  of  the  JDE  algorithm,  which  fits 
the  dynamic  JDE  problems  more  naturally  and  inherits  JDE’s  theoretical  superiorities. 
Further,  we  also  proposed  a  joint  performance  measure  in  the  measurement  space  for 
dynamic  JDE  problems.  To  our  knowledge,  this  is  the  only  perfonnance  evaluation 
framework  currently  available  for  JDE  evaluation. 

For  the  JDE  approach  of  this  project,  we  have  applied  it  to  several  problems  in  different 
areas.  We  have  developed  algorithms  for  joint  identification  and  tracking  of  multiple 
chemical,  biological,  radiological,  nuclear,  and  explosive  (CBRNE)  clouds  based  on 
sparsity  pursuit.  We  have  also  developed  procedures  for  joint  estimation  of  state  and 
parameter  in  power  systems  using  synchrophasor  measurements. 

Target  Information  Processing 

Target  infonnation  processing  refers  to  processing  of  infonnation  concerning  an 
uncertain  number  of  targets  in  an  uncertain  environment  using  uncertain,  imprecise, 
and/or  vague  data  from  single  or  multiple  sources.  It  includes  target  detection, 
discrimination,  classification,  recognition,  identification,  as  well  as  tracking.  Many  target 
information  processing  problems  involve  both  estimation  (i.e.,  approximate  a  continuous- 
valued  quantity)  and  decision  (i.e.,  choose  one  from  a  discrete  set  of  candidates). 
Decision  in  this  sense  includes  detection,  discrimination,  classification,  recognition, 
identification,  selection,  association,  ranking,  hypothesis  testing,  matching,  etc. 
Parameter  estimation,  signal,  image,  or  state  estimation,  prediction,  filtering,  smoothing, 
forecasting,  and  regression  are  examples  of  estimation.  Target  detection,  discrimination, 
classification,  recognition,  and  identification  are  basically  decision  problems,  which  often 
contain  embedded  estimation  sub-problems.  Target  tracking  are  primarily  estimation 
problems  with  embedded  decision  sub-problems. 

We  have  completed  two  important  parts  of  an  ongoing  in-depth  up-to-date  survey  on 
maneuvering  target  tracking:  (a)  models  of  ballistic  and  space  targets  and  (b)  nonlinear 
filtering  techniques.  The  nonlinear  filtering  part  consists  of  three  subparts.  This  series  has 
already  made  considerable  impact  on  target  tracking  research  and  development.  In 
addition,  we  have  developed  nearly  optimal  algorithms  for  target  tracking  using  range 
and  direction  cosine  measurements,  which  is  a  nonlinear  filtering  problem  whose  optimal 
solution  is  beyond  practical  region.  Other  significant  contributions  include:  (a) 
development  of  hybrid  grid  multiple-model  estimation  approach  and  its  application  to 


maneuvering  target  tracking;  (b)  development,  implementation,  and  performance  study  of 
several  parallel  particle  filtering  algorithms  for  real-time  satellite  tracking,  and  joint 
multitarget  probability  density  tracking  of  ground  targets  (track-before-detect)  using 
computer  cluster  and  graphics  processing  unit. 

Estimation  and  filtering  theory  is  one  of  the  most  important  foundations  of  target 
information  processing.  We  have  made  significant  contributions  in  this  aspect.  More 
specifically,  we  have  developed  a  new  framework  for  state  estimation  with  point  and  set 
measurements  that  can  handle  effectively  many  diverse  applications,  including 
particularly  many  practical  problems  in  target  information  processing.  Highly  related 
with  this  new  framework,  we  also  investigated  estimation  and  filtering  for  Gaussian 
variables  with  linear  inequality  constraints.  This  has  important  applications  in  ground 
(especially  on-road)  target  tracking. 

The  states  of  some  dynamic  systems  satisfy  certain  constraints  arising  from  physical  laws, 
mathematical  properties,  or  practical  constraints.  A  typical  example  is  ground  target 
tracking  on  a  road  network.  We  have  made  significant  contributions  in  several  aspects  of 
this  important  topic.  First,  we  have  proposed  several  algorithms  in  different  forms  of  the 
linear  minimum  mean  square  estimator  for  this  problem.  They  are  all  optimal  in  the 
linear  class.  Second,  we  have  developed  a  general  method  to  construct  an  unconstrained 
dynamic  model  that  is  mathematically  equivalent  to  the  original  system  with  constraints, 
thus  simplifying  the  constrained  problem  to  an  unconstrained  problem.  This  model  has 
several  important  desirable  properties,  including  clear  physical  interpretation  and  high 
computational  efficiency.  Third,  we  have  made  an  important  finding:  under  certain 
conditions,  although  equality  constraints  are  indispensable  in  the  evolution  of  the  state, 
update  by  them  is  redundant  in  optimal  filtering;  however,  if  there  is  model  mismatch, 
update  by  equality  constraints  is  necessary  and  helpful.  Fourth,  unlike  the  existing 
system  conversion  based  design  techniques,  we  propose  a  new  systematic  way  to  design 
and  analyze  linear  equality  constrained  linear  dynamic  systems  through  a  direct 
elimination  technique,  where  the  desired  model  class  is  given  and  only  the  distribution  of 
the  initial  state  and  driven  process  noise  needs  to  be  determined.  This  method  is 
comparatively  much  easier.  We  also  found  that  the  existing  fonnulations  of  linear 
equality  constrained  linear  dynamic  systems  only  cover  a  small  part  of  the  whole  class. 

Based  on  our  work  in  these  areas,  we  have  also  developed  algorithms  and  designs  for 
aided  strapdown  inertial  navigation  for  autonomous  underwater  vehicles.  This  was  a 
practical  project  funded  by  the  Naval  Oceanographic  Office. 

Data  Fusion  for  Estimation 

Estimation  fusion  is  data  fusion  for  the  purpose  of  estimating  some  quantity,  usually  a 
parameter  or  a  process.  It  is  an  essential  part  of  target  information  processing  when 
multiple  sensors  are  used.  Abundant  results  in  this  area  have  been  obtained.  They 
include  several  aspects. 

•  Optimal  fusion  requires  knowledge  of  cross-correlation.  Unfortunately,  this 
knowledge  is  sometimes  unavailable  in  practice.  In  view  of  this,  we  have  developed 


three  fault- tolerant  fusion  rules  for  this  case:  fast  covariance  intersection,  generalized 
convex  combination,  and  analytic  center  approach. 

•  We  have  proposed  several  compression  rules  for  sensor  data  based  on  which  optimal 
distributed  fusion  will  have  perfonnance  that  is  globally  optimal  under  fairly  general 
conditions. 

•  We  have  developed  optimal  LMMSE  fusion  in  the  form  of  quasi-tracklets  to  handle 
cross-correlated  cases,  along  with  analysis  of  its  performance  and  presentation  of 
necessary  and  sufficient  condition  for  its  optimality. 

•  Estimation  fusion  for  the  case  of  multiple  dynamic  and/or  measurement  models  was 
never  considered  before  due  to  its  complexity.  We  have  successfully  developed 
several  such  fusers. 

•  Almost  all  existing  fusion  results  rely  on  some  level  of  probabilistic  or  statistical 
description  of  the  problem,  which  is  not  available  or  appropriate  in  some  cases.  With 
this  understanding,  we  proposed  a  new  formulation  in  the  H-infinity  setting,  which  is 
robust  against  descriptions  and  assumptions,  and  successfully  developed  several 
corresponding  rules  for  centralized  and  distributed  fusion,  which  is  applicable  even  to 
nonlinear  delayed  systems  with  multiple  sensors. 

•  Besides  fusion  results  for  filtering,  we  have  also  obtained  theoretical  results  for  fusion 
for  optimal  smoothing,  which  has  been  largely  overlooked  so  far  by  the  fusion 
community. 

UAV  Team  Path  Optimization  for  Search  and  Track 

To  better  serve  the  Anny's  mission,  one  application  focus  of  the  project  is  path  planning 
of  a  team  of  unmanned  aerial  vehicles  (UAV)  for  joint  detection,  localization,  and 
tracking  of  multiple  targets.  Another  is  ground  target  tracking — track  an  uncertain 
number  of  possibly  crossing  targets  using  data  transmitted  from  multiple  sensors  (e.g., 
imagers  and  radars)  onboard  a  moving  platfonn  as  well  as  topographic  information  such 
as  road  maps. 

Most  UAV  team  missions  have  a  dual  purpose  of  search  and  surveillance,  which  entails 
not  only  finding,  but  also  monitoring  of  targets,  including  their  locations  and  motions. 
Among  the  central  topics  of  UAV  missions  is  path  planning  for  search  and  surveillance. 
It  is  vastly  different  from  the  traditional  path  planning  (e.g.,  in  robotics),  which  is  largely 
a  “how-to-go-from-A-to-B”  problem.  Traditional  search  or  tracking  theoretic  approaches 
based  on  optimizing  detection  probability  or  estimation  error  would  not  meet  the  diverse, 
competing  needs  of  a  UAV  mission.  Unlike  existing  path  planning  of  a  cooperative 
UAV  team,  which  handles  the  competing  objectives  in  a  piecemeal  manner,  we  took  a 
systematic  JDE  approach:  we  proposed  a  solution  based  on  the  introduction  of  a  new 
performance  index — gain  in  the  information  value — which  pennits  naturally  joint 
optimization  of  the  objectives  of  target  detection,  target  tracking,  and  vehicle 
survivability  nicely  for  search  and  track  missions. 

More  recently,  we  have  obtained  significant  theoretical  results  for  dynamic  re -planning  of 
the  UAV  team  path  for  detection,  localization,  and  tracking  that  is  capable  of  adapting  to 
real-time  changes  in  the  command,  intelligence,  environment,  etc.  These  results  are 


significantly  more  solid  than  existing  ones.  In  a  dynamic  situation,  events  that  call  for  a 
change  of  the  plan  may  occur,  including  the  arrival  of  a  new  command  or  intelligence, 
detection  of  a  new  target,  loss  of  a  UAV,  a  sudden  change  of  weather,  etc.  Therefore,  an 
appropriate  time  horizon  for  re-planning  must  be  detennined.  If  it  is  too  long  or  too  short, 
the  updated  plan  may  be  poor.  There  is  little  research,  if  any,  regarding  the  detennination 
of  the  optimal  planning  horizon.  We  have  initiated  a  theoretical  study  of  this  important 
topic.  Our  work  presents  a  planning  horizon  that  is  optimal  in  the  sense  of  minimizing 
errors  in  planning  time.  It  is  intended  for  the  use  in  mission  planning  but  has  many  other 
applications. 

Technically,  UAV  path  planning  for  target  detection,  localization,  and  tracking  is  a 
problem  of  constrained  multiple-objective  optimization.  As  is  well  known,  there  is  an 
optimal  set  (i.e.,  Pareto  front)  in  which  each  point  corresponds  to  a  certain  tradeoff 
among  the  values  of  the  objective  functions.  Solutions  to  such  a  problem  are  not  unique 
in  general.  Which  of  the  many  Pareto  optimal  points  is  the  “best  trade-off”?  A  decision  is 
needed  as  to  which  Pareto  optimal  point  provides  the  best  tradeoff  among  all  alternatives. 
A  natural  approach  is  to  optimize  a  convex  combination  of  the  individual  objectives.  We 
have  developed  such  a  solution  for  cooperative  UAV  path  optimization,  along  with  an 
efficient  method  of  getting  the  weights  from  the  Pareto  optimal  points.  We  are 
developing  methods  based  on  a  special  scalar  objective  function  that  suits  particularly 
well  to  our  problem  of  UAV  path  optimization  for  joint  detection,  localization,  and 
tracking  of  multiple  targets. 

Multiple-Model  Approach 

The  multiple-model  (MM)  approach  can  be  treated  as  a  special  case  of  the  joint  decision 
and  estimation  (JDE)  approach,  which  is  the  focus  of  this  project.  It  provides  the  state- 
of-the-art  solutions  to  many  problems  involving  estimation,  filtering,  control,  decision, 
and/or  modeling.  It  has  three  generations:  autonomous  MM,  cooperating  MM,  and 
variable-structure  MM  (VSMM),  of  which  the  VSMM  is  the  most  advanced  and 
powerful.  Significant  results  have  been  obtained  in  several  aspects. 

•  We  have  developed  three  new  VSMM  approaches:  (a)  best-model  augmentation 
(BMA),  (b)  hybrid  grid,  and  (c)  second-order  Markov  chain.  BMA  is  a  general  and 
promising  new  VSMM  algorithm.  It  is  a  generalization  of  the  well-regarded 
expected-mode  augmentation  (EM A)  algorithm  developed  by  us  before.  It  is 
applicable  whenever  EM  A  is  and  they  are  virtually  the  same.  BMA  still  applies  when 
EM  A  does  not,  such  as  when  models  have  different  structures.  The  hybrid-grid 
approach  uses  a  model  set  that  is  a  combination  of  a  fixed  coarse  grid  and  an  adaptive 
fine  grid.  The  second-order  Markov  chain  based  multiple-model  algorithms 
developed  is  particularly  suitable  for  maneuvering  target  tracking. 

•  Perhaps  the  most  important  task  in  the  application  of  the  MM  approach  is  the  design 
of  model  set.  We  have  also  made  significant  progress  in  this  aspect.  We  have 
proposed  two  model-set  design  methods.  The  unifonn  model  set  design  is  based  on 
number  theory  and  has  general  applicability.  The  second,  moment-matching  based 
approach  is  particularly  suited  to  the  hybrid-grid  approach  to  MM  estimation 
developed  recently. 


•  Taking  advantage  of  the  great  power  of  the  MM  approach,  we  have  also  formulated 
the  problem  of  fault  detection  and  isolation  in  the  MM  setting  and  provided  a  solution 
that  outperforms  by  far  existing  ones.  This  has  been  done  for  vastly  different 
applications:  (a)  sensor,  actuator,  or  system  faults  of  an  aircraft  (b)  heating,  air 
conditioning,  and  ventilation  (HAVC)  in  building  automation  and  (c)  machine  wear 
prognostics  and  remaining  useful  life  prediction. 

•  In  addition,  we  have  obtained  significant  results  for  distributed  MM  fusion,  that  is, 
fusing  local  estimates  obtained  based  on  multiple  dynamic  models. 

Evaluation  of  Decision  and  Estimation  Algorithms 

Science  and  engineering  abound  in  algorithms  for  decision  or  estimation.  However  solid 
such  an  algorithm  is  in  theory,  its  performance  and  characteristics  must  be  evaluated  in 
practice  to  serve  a  number  of  purposes,  such  as  verification  of  its  validity,  demonstration 
of  its  performance,  and  comparison  with  other  solutions. 

We  have  developed  a  novel,  theoretically  solid  approach  to  perfonnance  evaluation  that 
is  general,  comprehensive,  and  straightforward  to  implement  without  the  need  to  know 
the  ground  truth.  It  can  always  rank  very  different  decision  algorithms  objectively;  it  has 
no  difficulty  for  cases  with  two  or  more  choices  (or  hypotheses),  misspecification  (i.e., 
the  truth  is  not  one  of  the  hypotheses),  and/or  where  hypotheses  are  composite  (i.e., 
having  unknown  parameters);  and  it  does  not  need  to  know  the  functional  form  of  the 
truth  or  hypotheses.  This  is  a  very  significant  development.  It  is  potentially  a 
breakthrough  in  decision  perfonnance  evaluation.  Past  and  existing  measures  of  decision 
performance  are  seriously  flawed  or  limited.  Our  method  is  the  only  one  known  to  us 
that  overcomes  many  difficulties  (including  all  those  listed  above)  naturally  and  easily. 

We  have  developed  an  array  of  metrics  that  measure  absolute  or  relative  performance  of 
estimation.  They  suit  different  applications.  We  have  clarified  widespread  misuse  of  and 
misconception  about  the  most  popular  estimation  metric:  root-mean-square  error.  We 
have  also  introduced  an  important  concept  of  optimism,  pessimism,  and  neutralism  to 
characterize  many  estimation  performance  metrics  regarding  whether  they  focus  on  good 
or  bad  performance.  We  have  also  initiated  the  study  of  comprehensive  measures  of 
estimation  performance  evaluation.  The  practical  value  of  these  largely  theoretical 
developments  has  been  quickly  recognized  by  the  target  information  processing 
community.  For  example,  based  on  his  team’s  comparative  studies,  Dr.  Erik  Blasch  of 
Air  Force  Research  Laboratory  appraised  highly  of  the  practical  value  of  our  work  on 
performance  evaluation  metrics  for  data  fusion  and  target  tracking  and  classification. 

Most  estimators  and  filters  provide  assessments  of  their  own  estimation  errors,  often  in 
the  form  of  mean-square  error  and  bias.  Are  these  self-assessments  trustable?  What  is  the 
degree  to  which  they  are  trustable?  We  have  raised  such  questions  formally,  referred  to 
as  credibility  of  estimators,  formulated  the  problem  theoretically,  and  provided  two  types 
of  solutions:  credibility  tests  for  qualitative  questions  of  the  first  kind  and  credibility 
measures  for  quantitative  questions  of  the  second  kind.  These  results  are  significant. 
They  address  an  important  practical  problem  of  estimation  that  has  been  largely 


overlooked  in  theory  but  are  badly  needed  in  practice.  We  have  also  shown  that  one  of 
the  credibility  measures  developed  is  truly  a  distance  metric  and  have  good  application  in 
many  areas  outside  credibility  evaluation,  such  as  statistics,  data  fusion,  matrix  theory, 
and  general  data  driven  performance  evaluation. 

We  also  applied  theoretical  study  in  performance  metrics  and  statistical  inference 
algorithms  to  haplotype  inference  problem  in  bioinfonnatics,  orbital  evasive  target 
tracking  and  sensor  management  in  space  situational  awareness,  joint  identification  and 
tracking  of  contaminate  clouds,  remaining  useful  life  prediction  of  battery  and  other 
mission  critical  components  in  fault  prognosis. 
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